Skip to main content

tv   [untitled]    September 28, 2014 10:30pm-11:01pm PDT

10:30 pm
>> there are three ways to interact, there is the basic spread sheet view and it is like looking at excel and you can also download the data into a variety of formats if you have a particular application that you want to use to analyze the data and then we have the application programming enter face and we have been working recently with the cold for america and there are a number that have been interested in working, and they can build the websites and the software applications by using our data as the source data and then whenever the data updates the software will update as well. if you are not a programmer and just at the spread sheet level, which is fine you can actually do quite a bit and using the website you can aggregate the data and filter and some of the dash boards use that functionality to build the
10:31 pm
charts and graphs and the powerful thing about using this tool is that when the new contributions come in, for instance, and let's say that you build a graph that was analyzing the contributions your graph will update automatically and you will not need to build a new graph every time that new financial data comes in and the last thing that you can do is that you can mash up the data so you can take the data and even if the data source is from another department and if, for instance, the city's geographic team posts a zip code map and we have data that aggregates to the zip code level. in this is a that is right ha the staff presented on the information technology that shows that each department's contributions to the open data effort and despite the fact that we are one of the smallest departments, we are basically the largest contributor by far,
10:32 pm
and the second, department is there, and that is, data sets, that were contributed where the document and the department did not label they take the information and the lobbyist forms that are filed with us and the campaign reports which are compiling the data together and we put it altogether, on one display. so how do people do this before we have the dash boards and i think that it is important to get an idea of where we have come from, when i started in 2005, on a filing deadline, all of the campaign reports came in on paper, and the reporters would come into our office and go into our public access room. and they, and all of the filings would have just come in and they would sit through
10:33 pm
unorganized campaign filings and try to make the sense of it. and then, in 2007, when the contractor with the net file we allowed the people to download the data, in large quantities and also search it, and one of the problems with search is that it assumes that you know what you are looking for before you run the search. and the other problems with the data is that you need to understand the various codes in the data which are defined by the state's campaign finance format. and then, there is the element of, as he likes to say, there you are sure drinking from a fire hose, there are 260,000 transactions and trying to make the sense of it is difficult. so one of the things that we want to do when building the dash boards is trying to allow the people to filter out the noise and what i mean by filtering out the noise is if you are looking at a ballot measure, and they received, half a billion dollars from one
10:34 pm
source, and then they received, you know, 50 contributions, you know, to the $100 dollar level, and if you only had a few minutes to look at it, you probably want to find the half a million contribution and not the smaller ones. and so, why these dash boards focus on a lot of allowing you to see that information, quickly. and so let's try to take a look at it and see if you guys can read it from here. >> we have the home page and down here, there is a link to the dash boards. so, this first view shows the activity in the 90 day late reporting period and so late contributions, they are disclosed when a committee receives the contributions in total in the aggregate of 1,000 dollars or more in the 90 days before the election and that could be a contribution and in monetary contribution, or in-kind, contribution or a loan.
10:35 pm
and so, over on the left, here, this box, we are showing total contributions per day, and so you can't see on the bottom, it is showing the days and the amounts so the amounts are up to half a million dollars and so right away you can see that there are about peak days, where large contributions were coming in. so, a couple of ways that you can interact with this page, and you can either click on it, or one of the peaks, or you can filter it using the tools at the top. on the right here, it is very hard to see and there is actually a map of california, and you can see some contributions here and coming from the bay area and then down on the bottom there are some coming from the los angeles area and let's click on one of the contribution and let me click on this first peak. and so we have half a million dollars coming from the fcpier 70, residential group that is
10:36 pm
going to a committee that they are controlling and they loaned this committee the money which was going to allow them to build and project with what they are trying to build. and then over here, it is in and you can't see it because of the contrast, but it tells you the zip code and it zooms into the area in san francisco where they are located. >> in addition, there are other ways that you can look at this, for instance, at the top here, we have this tool, which allows us to filter out by an amount, and let's say that we want to look at contributions of greater than $100,000, and so i can literally just drag this tool and i will reshape the graph and a list of contributions at the bottom. and now, we are only looking at the larger contributions. and so these are just a much faster way of getting this information and looking through
10:37 pm
90 late contribution reports is what we will have to do if you are doing this from paper. and the next section that i am going to go over are the candidate pages and so we built a candidate for each race and so i am going to pull up the district ten race, because that has been a popular page during this election. >> on the data and it is current as of june 30th, there is a lot of activity since then and it will update in early october when the committees file the new financial statements. so on the left-hand side, we list the candidates that are qualified and supervisor cohen and right here we have a map of the district and not every person knows that they are in district ten. so up here, i can search and find this particular, address
10:38 pm
in district ten and so i am going to type in an address. so it zooms in and i know that this is in the district ten and this is the district that pertains to us, two charts and one is the total spending and the total contributions to the committee and so it is probably hard to read the labels on these. she had raised over 200,000 more, since then, the other s have applied for public financing and i sunshine expect that this chart will be looking
10:39 pm
different in october. we have a list of all of the contributers, so if you want to search this list, you can so you can browse through it and so we have taken out all of the contributions that don't apply to this race. we have a happen and a map of the map of the greater bay area, and it is showing all of the contributions and it puts in red, the most intense activity and this is actually coming from district ten and
10:40 pm
10:41 pm
10:42 pm
this is the last section lobbyist ands their contribution to candidates. and so because they are required on a monthly basis to report any of the contributions that they are making or arranging or delivering. we have been the starts that are lifting to the local office in november and then right here, it shows all of the firms and what you can do, you can actually mouse over any candidate and it will display the firm and how much money they have been giving. and so you can see here, that mark far ill has received the most money, and just to pick on him, what i can do is i can
10:43 pm
actually click the search box and this is actually interactive and so i can actually just type in farrell, and it will rebuild the chart so that we can look at some of these smaller lines and see which firms are giving the smaller ones as well. and i say, okay, there is this $400 240u,, for the association of realtors and let's say that i want to do more research on that and all that i have to do at the bottom is type in the realtors. and they ril rebuild the chart and show me all of the candidates that have received the contributions from the san francisco association of realtors and so you have supervisor tang and weiner. if this, chart piques the interest of the user, they can actually do the additional research and don't have to trust my numbers and they can click it to the bottom and take
10:44 pm
it over to the website and they can either work with my chart or it will tell them what i based this chart on, and it will actually take them to the original data set with all of the contributions in 2010, and so they can download and build their own charts on top of you can filter out the notice noise and this allows you to get to the contributions quicker. >> this is the ballot dashboard and this allows you to look at the activity by measure without knowing any of the committee names involved. and in addition, i want to be able to answer a series of questions, that are quite common with the campaign finance data. and so, what measures are on
10:45 pm
the ballot? which committees are supporting each measure and who is contributing in support or in opposition fp each measure? and who does the future leaders work for and where the contributor is from and who is making loans to the committee and in-kind contributions. and so let's take a look at it. so, on this page, and this is where i should say, we are not going to post this until october, when we get the complete data because at this point, most of the committee is formed after the semiannual statement was due. and so, this is part of a sneak peek of how this is going to work, at the top here, we have a list of all of these questions that i just read off on the presentation. and then, at the bottom here, we have a list of all of the measure and what do you is i can click on one of these
10:46 pm
questions and for instance, which committee support or oppose each measure and so you can click on it and it will display, each committee on the left here. and then, the position is indicated by the color, and so supporting committees are always labeled with orange, and the opposing committees are labeled with blue. and on the right here, i have a tool where i can change the measure that i want to look at so what i have to do is click on the smirs and rebuild all of the charts, and based on the measure that i chose and show me the committee and how much they are raising and how much they have spent and it shows me that their current cash balance and how much debt they have. >> the next question that i have up here is who is contributing the ballot measure committee? and so, one of the problems is that again, filtering out that noise and so how do you, find this high dollar contributions? what this chart represents is a total contributions from all
10:47 pm
contributers who are supporting or opposing the measure and then they are labeled by color, whether they are supporting or opposing contributions and the size of each contributor indicates the amount of their contribution. and so, the measure that we are looking at right now is measure h and so you can see here that two-thirds of the total contributions are coming from three people. and we probably can't read it on there, but they are actually coming from the same family. and so, we have a 3 people coming from the same family and then on the supporting side we have two people coming from the same family representing this section and the system will allow you to now service some of these smaller ones and be able to do the names of these contributers, but the point of this really is to see, these large contributers and who is driving these measures. for instance, if i click on a different measure, there is a measure l of the transportation measure and we can see that you know, two-thirds of the money is actually coming from one
10:48 pm
person. and then the further look at this, and by looking at who is the individual of who you are working for and if you have multiple contributers working for the same company and it will represent the company in its own box here and two of the three contributers who are opposing will actually work for the same company. >> we also show where the contributers are from. and so right now you can't see it because this is a map of the entire united states, but, actually the contributers are supporting measure h, and some of them are coming from new mexico some of them from colorado and 20,000 that are coming from there and then if we zoom in on san francisco, we can see that also a large amount of money is coming from around golden gate park which will make sense because measure
10:49 pm
eight relates to golden gate park. >> and just by clicking on a different measure, they will rebuild the map and show where the money was coming from in san francisco or outside of san francisco, and this one was coming from morin. we are also showing the loans that are committees are receiving and so here is where we see, things that don't measure off and this is the half a million dollar loan and it has not been paid back. and we also revealed who the lenders are. >> and then the last thing that we show, are any in-kind contribution and so for instance, again on measure f, we have about $70,000 donated by the developer, and donate the employee time of $70,000 and so as the campaign and that is the ballot measure of
10:50 pm
dashboard and these are a lot east tore do the research, than looking at the data. and one of the problems with the data, is ballot measure committees are required to change their names frequently when they receive, large donations they may become the top donor and so the names of that individual needs to go into the name of the committee. it is good for putting on the communications so the person reading the communications knows who the top donors are and it makes it hard to do the data research and so this solves our problem for the person who wants to do this kind of research. okay, so the last dashboard this democracy label, and this is designed by professor leavitt, and he published it in
10:51 pm
a paper, confronting the impact of citizen's united in the yale law and policy review in 2010. and so he tries to in this paper part some of the fears of corporate expenditure and one of the ideas is that the corporations will spend enough on speech to cause the voters to elect the candidates preferred by the corporations. and so yes, the question, is does the peach change the voter's minds? and so it brings up that the voters may, equate the breath of the support and may put more faith than is deserved or it is possible that substantial massive speeches are unstoppable electoral force. and so, he says that the campaign finance regulater will argue that the disclosure is what will combat these issues. but one thing that he points out is that the disclosure reports points out on the
10:52 pm
financial statements which goes to a central source and it is hard to filter out the noise of those statements because there is so much on them. and they are complicated. and the voters don't necessarily have the time to look at those reports or look through all of that data. >> so he argues for the straight forward disclosure label that will be put on the communications that is modeled after the nutrition label. so he calls it the nutrition facts label. and his label is focused on facts that will be spending money effecting candidate races. what we did was we focused it on the ballot measure races. and but he argues that it will provide, or an alert to voters, and with a large speech is coming from a few entities so if you saw a label that said, and let's say that you received a mailer and said that it was supported by three people and you can assess that there is not a lot of popular support
10:53 pm
for this measure, and also the portion of financial support that is generated by the top x, you know, five, contributers, for instance. and so you can see that if the majority of the money is come froming a few individuals. so in our version, we made a few changes which i will go over. and let's take a look at it. so on the side here i have a list of the committees that have failed as of the june deadline and what i can do is i can actually click on one of the committee and rebuild the label and show us who the top contributers are and how many supporters there were and the total contributions that are received and one thing that we changed and in the original version, they showed the percent from the top five and one thing that i thought was
10:54 pm
important, was you don't necessarily know if you list the top five contributers and if the top contributor and the fifth contributor are contributing in the same week, and you might assume that they are. and that is not necessarily the case for a lot of these measures and in this one, we can see sean parker here contributed $49,000 of the total $72,000 and the fifth contributor talking on here, contributing $1,000, and just so happens to be on the top five but it is not really in any comparison to sean parker. and because we are doing this on a computer and not on a communication label, we built in this functionality and you click on the sean parker and you can run a certify sxfp it will google who is sean parker and he is a entrepreneur that co-founded nabster and just to say the web searches are only as good as they can be. but at least, it will give you
10:55 pm
a start on identifying some of these people. and then we get to the san franciscans for the safe and affordable city and they have four supporters if you received a communication and had a label like that and it was closer to the election, it might send a warning flag. and so the campaign finance, dash boards, those are available now on our website, and those, again, focus on the candidate races and then the democracy, facts label is and those will be released after the first preelection deadline in early october, any questions?
10:56 pm
>> commissioners? >> any questions? >> i have a couple, first of all, mr. massey, i think that this is really accident, ... excellent, and i think that the greatest tools to be able to see in real time it is and going to be a asset for the city. one is regarding the integrity of the data, what are we doing as a city or as an ethics commission to insure that the data that is being stored is being protected? and i know that you can download and it manipulate it, and what are we doing to make sure that it does not get compromised. >> nobody on the commission staff actually has the rights to modify the data. and we can assist, and buyers
10:57 pm
with completing the forms, but, once they submit it, it goes over to the net file system and it is locked. and every city, in california, at this point that is doing electronic filing with the exception of los angeles is going through the same process. and so, they will not actually do anything to their systems unless they received the written requests from us. >> and so, is net file, responsible for maintaining the entegty of the data? >> yes. >> do you know what they do to insure that it is not hacked or compromised? >> well, first of all they keep an enormous number of back ups. and so, i am not particularly concerned about the integrity of the data in that we have so many snapshots of it, on top of that, where so many different component to it and there is the, actual filing itself, which we store the original electronic filing, and then there the data base of the
10:58 pm
transaction and so if anyone ever questions the transactions in the data base and you can go back to the source file that we received and we can log every step that those filings take when they go through our system and even though if someone just hit in the electronic filing system just hit the submit button and don't go anywhere, we know that information. and so, i feel quite confident in the security of the system. >> okay. what about traffic? is it, or do you feel like it is equipped to handle the type of traffic that you would expect during a hotly contested election? >> (inaudible). >> our particular, dashboards? >> so the dash boards run on a distributed network, where the serve provider will not run into that problem. >> and net files, one of the things that we are paying for that we were unable to provide with the city build system, is that infrastructure to handle
10:59 pm
the filing deadlines, and when we are on the city system with one server and now we have you know, a variety of servers, at a facility, to handle the traffic. so, this has not been an issue for us. >> and finally, has this been implemented anywhere else? so i have actually also be working with oakland and i have helped them get started on a project where they wanted to build the data visualizations for the mayor's race and they have two people on staff right now. so they actually got i community group in who did the remember sight work. but no, this state is not doing this and no other cities are doing this. what if anything are we doing to promote these new dash boards to the public? >> well, so, definitely with the democracy facts we are
11:00 pm
working with justin to help to promote this and you know, we are going to do all that we can to get the word out. and while there is still a website or social media. >> okay. >> thank you very much. >> thank you. >> public comment on item number three >> compliment the ethics commission, that that was a very good presentation and i am glad to see the democracy dashboard, i compliment you. and i have unfortunately used open data sf on a number of occasions and it is buggy. and so, if this is running on your servers and not theirs that would be encouraging. one of the problems that i had with the open data sf


info Stream Only

Uploaded by TV Archive on